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@ Recording medium reproduction apparatus and recording medium reproduction method for 
selecting, mixing and outputting arbitrary two streams from medium including a plurality of high 
efficiency-encoded sound streams recorded thereon. 

(57) There are provided a separation circuit for 
separating inputted unit data into individual 
sound streams ; a separation circuit for separat- 
ing each sound frame of the separated sound 
streams into a sound frame of main audio and a 
sound frame of multi-lingual audio; a main 
selection circuit for selecting one frame from a 
plurality of the separated main audio sound 
frames ; a multi-lingual selection circuit for 
selecting one frame from a plurality of the 
separated multi-lingual sound frames ; and a 
sound frame synthesis circuit for packing each 
sound frame selected in each of the selection 
circuit into a frame structure of MPEG2 audio. *— 
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The present invention relates to a recording me- 
dium reproduction apparatus for and a recording me- 
dium reproduction method of reproducing a medium 
including high efficiency-encoded audio data record- 
ed thereon. 5 

As high efficiency-encoding system of audio data 
there have been standardized MPEG1 (Moving Pic- 
ture Image Coding Expert Group), MPEG2, etc. 
MPEG1 audio comprises audio data of two channels, 
and MPEG2 audio is obtained by extending the w 
MPEG1 audio, so as to be applied to a multi-channel 
and a multi-lingual audio. 

FIG. 3 is a view illustrating a frame structure of 
the MPEG2 audio. As illustrated in FIG. 3, a frame of 
the MPEG2 audio comprises a MPEG1 header 1, 15 
MPEG1 audio data 2, a multi— channel header 3, mul- 
ti-channel audio data 4, multi-lingual audio data 5, 
and a MPEG1 auxiliary data 6. The MPEG1 audio 
data 2 is for monaural or stereo system. The multi- 
channel audio data 4 is for a surround system which 20 
comprises maximum 3.1 channels of stereo surround 
(2ch), center (1 ch), and sub-woofer (0.1 ch). Further, 
the multi-lingual audio data 5 is audio data to deal with 
varieties of languages, and may have maximum 7 
channels. A frame structure of the MPEG1 audio 25 
comprises a MPEG1 header, MPEG1 audio data, and 
MPEG1 auxiliary data. 

Some reproduction apparatuses each for a me- 
dium on which a plurality of audio streams high effi- 
ciency-encoded with the MPEG1, the MPEG2, etc. 30 
have been recorded have a function of selecting ar- 
bitrary two streams and mixing and outputting them. 
In such a reproduction apparatus, from a medium on 
which a background sound stream of a moving pic- 
ture for example and sound streams expressed by a 35 
plurality of languages have been recorded, the back- 
ground sound stream and the sound stream of one 
language are selected, and mixed and outputted. 

Thereupon, in the case of the audio stream en- 
coded with the MPEG1, audio data of the selected 40 
two streams are decoded through separate decod- 
ers, and decoded data are mixed to provide audio out- 
puts. Accordingly, two decoders and one mixer circuit 
are necessary in view of hardware. 

In contrast, in the case of the audio stream en- 45 
coded with the MPEG2, multi-lingual audio data are 
allowed to have 7 channels to the utmost as a stan- 
dard, and a decoder applied for the MPEG2 audio has 
a mixing function therein, so that only one decoder is 
seemed to satisfy the foregoing requirement This is 50 
however actually impossible. The reason is as fol- 
lows. 

The maximum bit rate of the MPEG1 audio and 
the MPEG2 audio is 384 kbps, and hence the total of 
the MPEG1 audio data, multi-channel audio data, and 55 
multi-lingual audio data should fall within 384 kbps. 
However, since 96 kbps or higher are required for 
each channel in view of a sound quality, from one 
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stream of the MPEG2 audio, the MPEG1 audio data 
and the multi-lingual audio data are selected respec- 
tively only as 192 kbps stereo data. These two stereo 
data correspond to a background sound and a sound 
of certain one language, so that a multi-lingual audio 
cannot be realized. There is a method to record a 
stream composed of the same background sound and 
a different language on a plurality of media and to re- 
produce one stream upon reproduction, so as to re- 
alize a multi-lingual audio. The method however caus- 
es redundancy to be increased in proportional to the 
number of the streams because of the background 
sound being the same. 

For this reason, even in the case of the MPEG2 
audio, a method has been applied in which two 
streams are selected, and audio data of these 
streams are decoded and mixed through sepa rate 
decoders, and outputted. Thus, two decoders and 
one mixer circuit are essential. 

For instance, data recorded on a medium is as- 
sumed to be an assembly of units, each unit being 
composed of a header 11, audio data 12 and video 
data 1 3, as illustrated in FIG. 4. The audio data 1 2 and 
the video data 13 are high efficiency compression-en- 
coded data encoded with such as the MPEG or the 
like. The audio data 12 comprises a plurality (m) of 
sound streams (#0, #m) 14, each sound stream 14 
being composed of a plurality (n) of continuous sound 
frames (#0, #1, #n) 15. The sound frame 15 com- 
prises a frame header 16 and frame data 17. 

FIG. 6 is a block diagram illustrating the structure 
of an optical disk reproduction apparatus for repro- 
ducing the data recorded on the optical disk. In FIG. 
6, numeral 101 denotes the optical disk on which data 
is recorded with a structure illustrated in FIG. 4. Nu- 
meral 1 02 denotes an optical pickup for reading a sig- 
nal recorded on the optical disk 101. The signal read 
by the optical pickup 102 is amplified in an RF ampli- 
fier 103 and is thereafter supplied to an RF signal 
processing circuit 104. The RF signal processing cir- 
cuit 104 subjects the amplified signal to waveform 
equalization and binarization to obtain data. Binary 
data outputted from the RF signal processing circuit 
104 is transmitted to a data processor 105 where the 
data is subjected to demodulation and error correc- 
tion. 

The output of the RF amplifier 103 is also trans- 
mitted to a servo control circuit 106. The servo con- 
trol circuit 106 detects tracking error and focusing er- 
ror from the output of the RF amplifier 103, and out- 
puts both detection signals to a driving circuit 107. On 
the basis of both detection signals, the driving circuit 
107 drives a feeding mechanism (not shown) of the 
optical pickup 102 for focusing control and tracking 
control. The servo control circuit 106 frequency-div- 
ides a synchronizing signal component extracted 
from the output of the RF amplifier 1 03, and transmits 
a frequency-divided signal to the driving circuit 107. 
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The driving circuit 107 drives a disk motor 108 based 
upon the frequency-divided signal. 

In contrast, the data subjected to the demodula- 
tion and error correction in the data processor 105 is 
transmitted to a system processor 109 on a data unit 5 
basis. The system processor 109 separates audio 
data and video data from the inputted data unit, and 
outputs the video data to an MPEG video decoder 
110. The system processor 109 selects two streams 
among m sound streams of the audio data from the 10 
inputted unit data, and outputs one of the two streams 
to a first MPEG audio decoder 111, and the other of 
the same to a second MPEG audio decoder 112. 

The MPEG video decoder 110 decodes the video 
encoded data and outputs the decoded video data to 15 
a video encoder 113. The video encoder 113 gener- 
ates and outputs a video signal for reproduction from 
the decoded video data. 

In contrast, the MPEG audio decoders 111 and 
112 decode audio data for each sound frame that con- 20 
stitutes each sound stream, and outputs the decoded 
audio data to a mixer circuit 114. The mixer circuit 114 
mixes the two audio data, and outputs the mixed au- 
dio data to a D/A converter 115. The mixed audio data 
is converted to an analog signal by the D/A converter 25 
115, and is thereafter outputted through an amplifier 
116 as a reproduction audio signal. 

In the conventional reproduction apparatus for a 
medium on which a plurality of high efficiency-encod- 
ed sound streams have been recorded, arbitrary two 30 
streams are selected, mixed, and outputted, and 
thereupon two decoders and one mixer circuit are re- 
quired in view of hardware, as described above. The 
conventional reproduction apparatus thus suffers 
from a problem of its being expensive. 35 

For solving the problems, it is an object of the 
present invention to provide a recording medium re- 
production apparatus and a recording medium repro- 
duction method wherein a hardware structure is sim- 
plified in the case where arbitrary two streams are 40 
selected from a medium on which a plurality of high 
efficiency-encoded sound streams have been re- 
corded and mixed, and the mixed signal is outputted. 

To achieve the above object, the present inven- 
tion provides in the first aspect a recording medium 45 
reproduction apparatus for reproducing a medium on 
which a plurality of streams of high efficiency-encod- 
ed sound data are recorded, each of the streams be- 
ing composed of a plurality of successive sound 
frames and including first sound data and second so 
sound data that is different for each of the streams, 
said recording medium reproduction apparatus com- 
prising: first separation means for separating the 
sound data read from said medium into individual 
streams; second separation means for separating a 55 
sound frame of each stream separated by said first 
separation means into said first sound data and said 
second sound data; first selection means for select- 
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ing one sound data from a group of said first sound 
data separated by said second separation means; 
second selection means for selecting one sound data 
from a group of said second sound data separated by 
said second separation means; and synthesis means 
for synthesizing the sound data selected by said first 
selection means and said second selection means 
into one sound frame. 

The present invention provides in the second as- 
pect a recording medium reproduction method for re- 
producing a medium on which a plurality of streams 
of high efficiency-encoded sound data have been re- 
corded, each of the streams being composed of a 
plurality of successive sound frames and including 
first sound data and second sound data which is dif- 
' ferent for each of the streams, said recording medium 
reproduction method comprising: a first separation 
process of separating the sound data read from said 
medium into individual streams; a second separation 
process of separating a sound frame of each stream 
separated by said first separation process into said 
first sound data and said second sound data; a selec- 
tion process of selecting one sound data from a group 
of the first sound data separated by said second sep- 
aration process; a selection, process of selecting one 
sound data from a group of the second sound data 
separated by said second separation process; and a 
synthesis process of synthesizing each of the select- 
ed sound data to one sound frame. 

The present invention provides in the third aspect 
a reproduction method of sound data, the reproduc- 
tion method comprising: granting the first sound data 
and the second sound data on one sound frame 
among a plurality of the sound frames; granting only 
the second sound data that is different in the type for 
each sound frame on the sound frames other than 
said one frame among a plurality of the sound 
frames; separating the first sound data from said 
sound frame on which the first sound data and the 
second sound data are granted; separating the sec- 
ond sound data from the one sound frame among the 
sound frame on which said first sound data and said 
second sound data are granted and the plurality of 
sound frames on which only the second sound data 
is granted; and synthesizing said separated first 
sound data and second sound data. 

According to the present invention, sound data 
read from a medium is separated into individual 
streams, and a sound frame of each separated 
stream is separated into first sound data and second 
sound data that is different for each stream. Further, 
one sound data is selected from a group of the sepa- 
rated first sound data, one sound data is selected 
from a group of the separated second sound data, 
and the selected sound data are synthesized into one 
sound frame. 

Provided that the sound frame has a frame struc- 
ture of, for example, the MPEG2 audio or the like, a 
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synthesized sound frame can be decoded with one 
decoder (decoding means) applied for the MPEG2 
audio. Additionally, since the decoder for the MPEG2 
audio has a mixing function, there is eliminated the 
need of provision of a mixer circuit for mixing the de- 5 
coded sound data outside the apparatus. Hardware 
structure is thus simplified. 

The above and other objects, features and ad- 
vantages of the present invention will become more 
apparent from the following description when taken in w 
conjunction with the accompanying drawings in which 
a preferred embodiment of the present invention is 
shown by way of illustrative examples. 

FIG. 1 is a block diagram illustrating the structure 
of an audio reproduction apparatus of an embodi- 15 
ment according to the present invention; 
FIG. 2 is a block diagram illustrating the structure 
of a packing circuit in the audio reproduction ap- 
paratus illustrated in FIG. 1; 

FIG. 3 is a view illustrating a frame structure of 20 
an MPEG2 audio; 

FIG. 4 is a view illustrating the structure of data 
recorded on a medium; 

FIG. 5 is a view further concretely illustrating a 
frame structure according to the present inven- 25 
tion; 

FIG. 6 is a block diagram illustrating the structure 
of a conventional audio reproduction apparatus; 
and 

FIG. 7 is a view illustrating a conventional frame 30 

structure corresponding to FIG. 5. 

In what follows, a preferred embodiment of the 
present invention will be described in detail with ref- 
erence to the accompanying drawings. 

FIG. 1 is a block diagram illustrating the structure 35 
of an audio reproduction apparatus of an embodiment 
according to the present invention. 

In FIG. 1, numeral 21 denotes an optical disk as 
a recording medium. On the optical disk 21 there is re- 
corded data in a unit composed of header data 11, au- 40 
dio data 12, and video data 13, as illustrated in FIG. 
4. The audio data 12 comprises a plurality (m) of 
sound streams 1 3, each sound stream 1 3 being com- 
posed of a plurality (n) of successive sound frames 
14. The sound frame 14 comprises a frame header 15 45 
and frame data 16. The audio data 12 is high efficien- 
cy-encoded data of, for example, the MPEG2. The 
frame data 16 therefore comprises an MPEG1 header 
1 , MPEG1 audio data 2, a multichannel header 3, mul- 
ti-channel audio data 4, multi-lingual audio data 5, 50 
and MPEG1 auxiliary data 6, as illustrated in FIG. 3. 

Numeral 22 denotes an optical pickup for reading 
a signal recorded on the optical disk 21. The signal 
read by the optical pickup 22 is amplified in an RF am- 
plifier 23 and thereafter supplied to an RF signal proc- 55 
essing circuit 24. The RF signal processing circuit 24 
subjects the amplified signal to waveform equaliza- 
tion and binarization to provide data. The binary data 



outputted from the RF signal processing circuit 24 is 
sent to a data processor 25 where it is rendered to de- 
modulation and error correction. 

The output of the RF amplifier 23 is also sent to 
a servo control circuit 26. The servo control circuit 26 
detects tracking errors and focusing errors from the 
output of the RF amplifier 23, and outputs both de- 
tected signals to a driving circuit 27. The driving circuit 
27 drives a feeding mechanism (not shown) of the 
optical pickup 22 based upon both detected signals 
for execution of focusing control and tracking control. 
The servo control circuit 26 frequency-divides a syn- 
chronizing signal component extracted from the RF 
amplifier 23 and transmits the frequency-divided sig- 
nal to the driving circuit 27. The driving circuit 27 
drives a disk motor 28 based upon the frequency-div- 
ided signal. 

The data subjected to demodulation and error 
correction in the data processor 25 is transmitted on 
a data unit basis to a system processor 29. The sys- 
tem processor 29 separates audio data and video 
data from the inputted data unit, and outputs the vid- 
eo data to an MPEG video decoder 30 and the audio 
data to a packing circuit 37. 

The MPEG video decoder 30 decodes the input- 
ted video data and transmits the same to a video en- 
coder 33. The video encoder 33 generates a video 
signal for reproduction from the decoded video data 
and outputs it. 

The packing circuit 37 separates the inputted unit 
data into individual sound streams, and further sep- 
arates each sound frame of the separated sound 
stream into sound data of a main audio and sound 
data of a multi-lingual audio. Herein, the main audio 
means the MPEG1 audio data 2 and the multi-chan- 
nel audio data 4 in the frame structure of the MPEG2 
audio illustrated in FIG. 3. The packing circuit 37 
thereafter selects arbitrary one sound data from a 
group of the sound data of the main audio and further 
selects arbitrary one sound data from a group of the 
sound data of the multi-lingual audio, and synthesizes 
(packs) these data to one sound frame with a struc- 
ture illustrated in FIG. 4. Details of the packing circuit 
37 will be described later. 

The sound frame obtained by the packing circuit 
37 is sent to the MPEG audio decoder 32 and decod- 
ed therein, and thereafter the main audio and the mul- 
ti-lingual audio are mixed and outputted to a D/A con- 
verter 35. The audio signal made an analog signal by 
the D/A converter 35 is thereafter outputted as an au- 
dio signal through the amplifier 36. 

FIG. 2 is a block diagram illustrating the detailed 
structure of the packing circuit 37. As illustrated in 
FIG. 2, the packing circuit 37 comprises a sound 
stream separation circuit 41 , m (#0 - #m) sound frame 
separation circuits 42, 43, .... 49, a main selection cir- 
cuit 50, a multi-lingual selection circuit 51 and a sound 
frame synthesis circuit 52. 
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The sound stream separation circuit 41 sepa- 
rates the inputted unit data into m sound streams, and 
provides the separated m sound streams to m sound 
frame (#0 - #m) separation circuits 42, 43 49 re- 
spectively. The sound frame (#0 - #m) separation cir- 5 

cuits 42, 43 49 separate each sound frame of the 

inputted sound stream into the sound data of the main 
audio and the sound data of the multi-lingual audio. 
The sound frame (#0 - #m) separation circuits 42, 
43, 49 output the sound data of the main audio to 10 
the main selection circuit 50 and the sound data of the 
multi-lingual audio to the multi-lingual selection circuit 
51. The main selection circuit 50 selects one data 
from the m main audio sound data, and outputs it to 
the sound frame synthesis circuit 52. In contrast, the 1 5 
multi-lingual selection circuit 51 selects one data 
from the m multi-lingual audio sound data, and out- 
puts it to the sound frame synthesis circuit 52. The 
sound frame synthesis circuit 52 synthesizes the 
sound data selected by the main selection circuit 50 20 
and the multi-lingual selection circuit 51, and packs 
the synthesized sound data into the frame structure 
of the MPEG2 audio illustrated in FIG. 4. Upon pack- 
ing header information is also rewritten. 

As illustrated in FIG. 5 for example, the sound 25 
frame #0 has a "background sound" as the sound 
data of the main audio and has the "Japanese lan- 
guage" as the sound data of the multi-lingual audio. 
The sound frame #1 has no sound data of the main 
audio and has the "English language" as the sound 30 
data of the multi-lingual audio. The sound frame #2 
has no sound data of the main audio and has the 
"French language" as the sound data of the multi-lin- 
gual audio. Thereupon, the main selection circuit 50 
selects a "background sound" that is the sound data 35 
of the main audio of the sound frame #0 from the 
sound frame #0 separation circuit 42. Selected herein 
the "English language", the multi-lingual selection cir- 
cuit 51 selects the "English language" that is the 
sound data of the multi-lingual audio of the sound 40 
frame #1 from the sound frame #1 separation circuit 
43. The selected "background sound" data and "Eng- 
lish language" data are synthesized in the sound 
frame synthesis circuit 52 as synthesized data illu- 
strated in FIG. 5. A conventional sound frame struc- 45 
ture corresponding to FIG. 5 is illustrated in FIG. 7. As 
illustrated in FIG. 7, a conventional sound frame has 
a "background sound" as the sound data of the main 
audio. 

According to the optical disk reproduction appa- so 
ratus of the present embodiment, high efficiency-en- 
coded audio data read from the medium is separated 
into individual sound streams, and each sound frame 
of each separated sound stream is separated into 
sound data of the main audio and the multi-lingual au- 55 
dio, and further one sound data is selected from the 
sound data of each separated main audio and the 
sound data of each separated multi-lingual audio re- 



spectively and the selected sound data are synthe- 
sized into a sound frame with the same frame struc- 
ture as that of the MPEG2 audio, as described above. 
Thus, only one decoder 32 for the MPEG2 audio is re- 
quired. 

Further, since the decoder corresponding to the 
MPEG2 audio has therein a function of mixing the 
main audio and the multi-lingual audio both after be- 
ing decoded, it is unnecessary to provide a mixer cir- 
cuit outside the apparatus. 

The hardware structure is thus simplified with 
the cost thereof reduced. 

It should be noted that in the present embodiment 
the decoder is unified by constructing the apparatus 
such that the two sound data are formed as the frame 
structure of the MPEG2 audio in the packing circuit 
37, but the present invention is not limited thereto. 
Also in high efficiency-encoding systems other than 
the MPEG2 for example, provided their decoder has 
a function of mixing the main audio and the multi-lin- 
gual audio, associated sound data may be packed 
into a frame structure of the high efficiency-encoding 
system. 

According to the present invention, as described 
above, sound data is separated into individual 
streams, and sound frames of each separated stream 
are separated into first sound data and second sound 
data that is different for each stream, and further one 
sound data is selected from a group of the separated 
first sound data and one sound data is selected from 
a group of the second sound data, and the selected 
sound data are synthesized to one sound frame. 
Hereby, the synthesized sound frame can be decod- 
ed with one decoder (decoding means) for the 
MPEG2 audio for example. Additionally, the decoder 
for the MPEG2 audio has therein a mixing function, 
so that there is eliminated the need of provision of a 
mixer circuit for mixing decoded sound data outside 
of the apparatus. A hardware structure therefore can 
be simplified. 

Claims 

1. A recording medium reproduction apparatus for 
reproducing a medium on which a plurality of 
streams of high efficiency-encoded sound data 
are recorded, each of the streams composed of 
a plurality of successive sound frames, each of 
the streams including first sound data and sec- 
ond sound data that is different for each of the 
streams, the apparatus comprising: 

first separation means for separating 
sound data read from said medium into individual 
streams; 

second separation means for separating 
sound frames of each-stream separated by said 
first separation means into said first sound data 
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and said second sound data; 

first selection means for selecting one 
sound data from a group of said first sound data 
separated by said second separation means; 

second selection means for selecting one 5 
sound data from a group of said second sound 
data separated by the second separation means; 
and 

synthesis means for synthesizing the 
sound data selected by said first selection means 10 
and said second selection means into one sound 
frame. 

A recording medium reproduction apparatus ac- 
cording to claim 1, 15 

wherein said second sound data is sound 
data which is different in language for each of the 
streams. 

A recording medium reproduction apparatus ao 20 
cording to claim 1, 

wherein said first sound data is recorded 
on only one sound frame. 

A recording medium reproduction apparatus ao 25 
cording to claim 3, 

wherein said first sound data is a back- 
ground sound. 

A recording medium reproduction apparatus ao 30 
cording to claim 1, 

wherein the apparatus further comprises 
decoding means for decoding the sound frame 
synthesized by said synthesis means. 

35 

A recording medium reproduction method of re- 
producing a medium on which a plurality of 
streams of high efficiency-encoded sound data 
are recorded, each of the streams composed of 
a plurality of successive sound frames, each of 40 
the streams including first sound data and sec- 
ond sound data that is different for each of the 
streams, the method comprising: 

a first separation process of separating 
the sound data read from said medium into indi- 45 
vidual streams; 

a second separation process of separating 
sound frames of each stream separated by said 
first separation process into said first sound data 
and said second sound data; 50 

a selection process of selecting one sound 
data from a group of the first sound data separat- 
ed by said second separation process; 

a selection process of selecting one sound 
data from a group of the second sound data sepa- 55 
rated by said second separation process; and 

a synthesis process of synthesizing each 
said selected sound data into one sound frame. 



7. A recording medium reproduction method ac- 
cording to claim 6, 

wherein said second sound data is sound 
data that is different in language for each of the 
streams. 

8. A recording medium reproduction method ac- 
cording to claim 6, 

wherein said first sound data is recorded 
on only one sound frame. 

9. A recording medium reproduction method ac- 
cording to claim 8, 

wherein said first sound data is a back- 
ground sound. 

10. A recording medium reproduction method ac- 
cording to claim 6, 

wherein the apparatus further comprises 
a decoding process of decoding said synthesized 
sound frame. 

11. Asound data reproduction method of reproducing 
sound data comprising the steps of: 

granting first sound data and second 
sound data on one sound frame among a plurality 
of sound frames and granting second sound data 
on the other plurality of sound frames, said sec- 
ond sound data being different in the type for 
each sound frame; 

separating the first sound data from the 
sound frame on which said first sound data and 
said second sound data are granted and further 
separating the second sound data from one 
sound frame among the sound frame on which 
said first sound data and said second sound data 
are granted and one sound frame among a plur- 
ality of sound frames on which said second 
sound data is granted; and 

synthesizing said separated first sound 
data and second sound data. 

12. A sound data reproduction method according to 
claim 11, 

wherein said first sound data is a back- 
ground sound. 

13. Asound data reproduction method according to 
claim 11, 

wherein each of the second sound data is 
sound data with a different language from each 
other. 
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